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ABSTRACT 


Ihessamplest  Largetr selection problem in hetero renéous 
bat is the two-on-one battle. For a prescribed duration 
mele, deterministic and stochastic models using 
Benchester's square law attrition mechanism are developed. 
Bonutions of these models, obtained by the application of 
EE! control theory, are given, including the complete 
lution of the deterministic model and the optimal 
Brett selection rule and expected pay-off for special 
EN - or che stochastic model. A numerical “approximation 
lop the general case of the stochastic model is obtained. 
Comparison of numerical results shows that the target 
Selection rule specified by the deterministic models 


=a ers from the one given by the stochastic model. 
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I. INTRODUCTION 


Doe o Ne Chi nections of mathematical models 
@ecombat is to provide insight for the development of 
@ectics. In general, the assumptions needed to make the 
Medel tractable are such that the results cannot be direct- 
Mmeapolied. Frequently, however, the results reveal a 
meme nure which is mbscured by the complexity of the real 
world problem. 

Maese are a number of different. approaches. Lo Gembat 
attrition Adel ing, each with its Own advantages and Qis- 
En uarasces. Generally speaking, greater realgty is intro- 
mecca into such models at the expense of increased 
uenmplexity. 

DES cto to-Desconsidered 315 whether che results ere 


influenced by the approach used. It may be that for 


Q) 


Eu ccular type of problem, a complex, difficult approach 
feewas nothing that could not be gained from a simpler 
mede]. 

One of the first mathematical models of combat was 
m sented by Rear Admiral Bradley A. Fiske, USN, in 
1905 [1]. Fiske considered an engagement between two 
fleets. He assigned a numerical value representing strength 
to each fleet and assumed that the damage a fleet could 


inflict was proportional to its strength. In a series 


of tables, he showed that the value of the weaker fleet 





ia relation toO the stronger {leet decreased avvan acceler 
ating rate as the battle progressed. Fiske's logical 
me velopment and conelusions arezche sarc as UMS MN PE 
formalized by Lanchester. 

Pioneering work on combat attrition modelling was done 
by F. W. Lanchester [2] in the early nineteen hundreds. 
me postulawed that the combat attrition process could be 
Mescribed by a system of ordinary differential equations. 

Banchester considered two types of combat: indiviaual 
eembae as represented by ancient combat; and modern com- 
EuLcharactepPrized by the introduction ol weapons with 
ieee firepower. 

Letting x(t) and y(t) represent the opposing force 
Bear  in.chewssirst case, ther attrition depends on both 


wice levels and is given by 


E - -ax(t)y(t) (1) 
I = -bx(t)y(t) (2) 


noue a and b are called Lanchester attrition-rate coefii- 
ecurs. Dividing Eq. 1 by Eq. 2 and integrating yields 


Pre torce level equation: 


5 (Copes O Ce) | 


which is known as the Lanchester linear law. If x is to 
win (x(t) > 0, y(t) = 0), then the initial force levels 


must satisfy 





x(0) » = y(0) 


In tbe second case, the attrition depends enly on the 


W osing force level and is given by 


Gx o>: 

SZ = -ay(t) 
E o 

m Dx E 


From this system of equations, Lanchester's square law, 


Bio) O 


me derived with the condition for x to win that 
a 
0) 700). 


samce Lanchestver's work, gaumerous extensions, modilica— 
Mens, ete., have been advanced. <A survey of the work in 
this area can be found in Dolansky [3]. 

An obvious drawback to the Lanchester formulations is 
Mia, they are deterministic. Given the attrition coeffi- 
Eent, jc es determined by Une ini I or le cud 
“arly, this is not true in actual combat. There are a 
Mesa many other factors, which may be considered as random 
Mmeriables, which enter into the determination. Apparently 
ene first stochastic formulation was given by Koopman [4,5]. 

Weiss [6] noted a number of deficiencies. Of particular 
Significance is the fact that the Lanchester model assumes 


that all units on a side are of the same type (homogeneous 





forces). In actual combat, there are units of many dif- 
ferent types on each side (heterogeneous forces). 

The simplest heterogeneous force model involves a 
merle force, Y, facing an Opposing force composed of two 
me s of units, Xj and X; The attrition B is 
ED ribed by some function of A CN MEME E and 
merece levels. The Y force commander faces an allocation 
e fire problem. How should he divide his fire between 
ana X,? 

im the following, GITTE and Stochastic models 
ot this problem are developed and the solution obtained 
Be application of optimal control theory is given. For 
mercticular numerical values, the optimal allocation of 


mre and the terminal pay-off are compared. 





table Eo Notat1on 


cme), x,(t), y(t) =- State variables, number of survivors 


p, 


cing. Aux at timen. 
p Specified marimum duration oPMtne battle. 


yee) valve vel wa surviver Of Une bavvilc OP A ne 


2: 


BeSpDectE ve. 
sp pattrition eoeffieient, rate at wnich one y attrits X. 
Eocte atowb3ch.one y.attnritsox,. 
em te at which one xX; attrits Ns 
m ee at whichwMene x, rrIUts Y. 


=e ecision variable, Inaction oiy fire directed at 














LI. eee eee Lee ne Wie 


The development of the model requires three major 
EE sions. An objective function must be chosen. A SEOD- 
Bene rule must be et and the structure of the attrition 
EEhanism selected. 

hmong the Y force commander*s "objectives might be to 
maximize Coole! tics! 1 eved ila Meee tne Casualties 
med or to maximize the -duration -of the battle. fhe 


meyective function used in this model is 


Dax rya- px tE) - qx4(T) 
$ 


Mira 1S, the Y force commander desires to allocate his 
memces to maximize the net worth of the survivors, the 
wnal pay-off. Appropriate choices of the weighting 

ES POPS, p, q, and r, —: Y's feeling regarding casual- 
mies, AL one extreme, p and q set equal to zero correspond 
memminimizing casualties incurred, while r set equal to 

w o essentially maximizes Casualties inflicted. IT can 
EN-bown that maximizing tne duration oí the battle Teads 
memo GQitiierent allocation policy. 

There are three ways in which the battle may end. One 
force may decide to disengage, either as a function of 
Casualties incurred or after some specified time, or one 
torce may be driven to zero. Inthe deterministic formula 
tion, there is a one-to-one correspondence between casual- 
ties and elapsed time. 


10 





The"Tollowinge stopping wule is uscd Nini Noes 
ith T specified, there are four states in which the battle 


ean end: 


SS CEA e ten lly oO OF Xs E) > 0 19 72856190 


(time expires). 


O O AS A A xr) 0 ou 


DOLO. SIM. Loses)s 


C, lis) = as 


ES OO E DADAS EN 


O SA mute = Oufnons0 S t €& T (draw). 


Eu cs C, to C, are referred to as Iiignt-to-tbe-finish or 
EEcnipal control battles, while C, is a prescribed duration 
Battle. The model is formulated as a prescribed duration 
mere le with consideration given to premature terminations 
MNAC, or C,). If T is large enough, the premature 
meeiroalilons will determine” the actual time™@ dar ee. 
The attrition structure used is the Lanchester square 


meer These choices lead to the rollowing model. 








fem CA AAA) A CT (3) 
0S<$<1 
dx, 
E. EE da,y(t) 
dx, 
a un (4) 
GNE | 
qi MEET: (bx, (t) N b,x,(t)) 
Dye. T specified. 


ll 





A number of assumptions are involved in the formulation 


oad use of the model. 


Al. 


re 
A3. 
AY. 
A5. 
A6. 


HU 
AB. 


Bach unit has perice In ormat Ion eres rd tine 
state and. location or “enemy Units: 

Fire may be shifted instantaneously. 

Piresis Uniformly Veiseribuged oVercsuPvgvinpaMM Ss 

AT] enemy units are within range. 

Metettects or sueceecss)ve rounds are independent: 

Ine"attrition coctiictents ajs a5, 0,, Dare 
contanti throuehnout the battle. 

Hrac tional casualties are allowed: 

a bn cibe Since the labelling o fonges is 


arbitrary. this ib a Noreste tive ascunpt Ion 


meeeohrough AS are inherent in the Lanchester square law 


formulation, as developed by Barfoot [7]. 


"mas problem was first™formulatedmand partially sotved 


by Isbell and Marlow [8], before Pontryagin announced his 


maximum principle. Using subsequent developments in modern 


optimal control theory, Taylor [9, 10] has obtained a 


pomplete solution to both the fixed-duration and the fignt- 


to-the-finish battle. 


T 





Ill. SOLUTION TO THE DETERMIN Sa CT MODEL 


hender vatron or Pay eR S SOUTO AS MEE EA 
lengthy and tedious. The results are summarized in Appen- 
az A. This section discusses Taylor's solution tecehniase 
mae che insight into the structure of the optimal allocaticn 
eNi ey provided by this solution. 


ie solution procedure begins by forming the Hamilton? a 


Ncc pays A EQ y 


3 p¿(t)(b,x, E Dl a 


Eure p,, p,, and PAE the dual variables associated witz 


X X, and Y respectively. 


I 2 


By the Pontryagin maximum principle”, maımızıne Eqs p 
ee all points in time yields the maximum of Eq. 3. Rewrit- 
Eus Eq. 5 as 

= {¢(a,p,(t) = S E SEE are cu) y 


4 ENTE + Bere) 


mets clear that the optimal control, 4* is given by 


H cl JL. eap bs) 
$* = (6) 
OA DEM ) sagas) 


lmhis paper uses the American form of the maximum 
Prenciple |i. Fonbtryagin; et. al., [412] usé an eoudvalcue 
torm which differs in Sign conventions. 


lige 





li can be shown that a;p, * agp. cannoteholdooven ca JEUNE C 
m erval cfietame, hence the optimal control iS-v0 adus 
Enoenteate flre agpaimet eme target Type. 

The adjoint system of differential equations for the 


Sel variables is given by 


ap 

E > bip, (t) 
at oP, 
dp, 


a2 = p,(t)a,6 + p,(t)a,(1-0) 


When the optimal value function is differentiabie, the 
Wal variables represent the change in the optimal value 
Enmwuebon caused by a change M"the corresponding state 
EU sbie. In particular, if no force has been driven to 
Mat che end of "the battle, the final cones Sane aie 
meat Variables are easily found. Differentiating Eq. 3 


Meee respect to the state variables yields 


Pet) = - p 
poc. == q 
PM. 


Pupetther AWvOre. ss dGiven (oO zero during ene cose 
mi the battle, the final values of the dual variables can 
no longer be determined as above; instead, the theory of 


Beave Variable inequality constraints must be applieds 
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or [Appendix E of 10] presents a detailed discussion 
eof this theory. 

When a force is@drivemneteszero, the Optima ere CTC] 
aid to enter a coneitralnt sub-awe. We point of entry 
EN duced a corner. In thuswprobilem, a nonnegativity 
Esmstpraint is € on a constrained sub-are. One treat- 
ment, developed by Gamkrelidze [12] is to modify the 
Bemııconian by adjoining the first time derivative of the 
Pemstraints to the criterion functional with additional 


Lagrange multipliers. 
E o = pea RS - DONDE TEO RS 
Er ME UTC ELE 
The H.'s are multipliers satism@ying 


= 0 MS S 
Ua jeg qe 


IV 
O 
> 
ii 
O 


as well as Gamkrelidze's condition 


li 
O 


E 
—— £ 0 for X: 


There are also corner conditions on the dual variables 
at an entrance to a constrained sub-arc. 27 D is driven 


mo zero at tis these are 


DE EN) 


il 


C 


S 


15 





In addition, the Hamiltonian lspeontinuous anoto 
corner. Approaching the corner (t,), $=1, p,b x approaches 
+ 
zero, and H,=0. Antera corner (irm aaO s a 


BO. From the continuity of the Hamiltonian 


Bee) mc pter» be 


4 + 
ey = mer, x, = 


therefore 


» a, + a, m 
ce) = e petu) m a, oy 


Cae? Cosmiestined=sub-arc with x,=0, 9 the muiviplier ic 


determined from the condition 


dH* 


m 


force yields 


u(t) = E (SECO TS). 


oince 





(a,b, S a,b,) 


Meine the adjoint equations (Eq. 7) it is clear that 
eamkredlidze's condition is only Satisfied on the con— 


strained sub-arc x,-0 Dem ERU 2 a,b 


0 TT 


shown that PS) DOE 
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A- -similar argumenti shows Chat Gemrrelase ls (cong my rem 
as satisfied on the constrained sub-arc 2 On yet; 
a,b, < a,b, which contradicts AB. Therefore, it is optimal 
to drive X, to zero only at the ena ol the battle Ea (aimee 
: values of the dual variables are known for 


E it is convenient to define the backwards time variable 


t=T -t OS tE T 

and so 
R ED es > . 
dt dt dt ` at l= l, 2, 3 (8) 


Substitution of Eq. 8 into Eq. 7 yields a system of differ- 

ential equations with known initial Conds tons. when cam 

E olived for the dual variables as a function of time. 
Myce the dual variable functions are found, the optimal 

control is given by Eq. 6. The time at which fire is 


Eu ched from X, to X, is found from 


TPt) = a p(t). 


The trajectories of the state variables are easily 
determined. For an interval (t,, t,) where $=1, Eq. 4 


becomes 


AX, 
ae men E x,(t,) given 


ar = 0 x, Coe) given 


- (bx, (t) + PASO y(t,) given 


O] O 
ct 
N 


iy 





PIG r can be solvedito getiiior t. Sot Sot. 


(e + ee) 


(Zen «| cosh (va, So) 





a,b, 
i) Dc C DES T 
i 1 — (V&ib.t) M ( 1 l l - 2022 l ) 
vab. | aP) 
E (9) 


mu) = YO cosa (Ya 00) 


(O o CE) 
A E AO 





va,D, 

Similarly, for an interval (t,, t,) where ¢ =0, Eq. 4 
Becomes 

ax, 

E 7 0 x,(t,) given 

ax, 

eee aa) A een 

d ; 

= ee St Deos OC) y(t,) given 


Een gives for t, $t S t, 


OO Se, 


[Dass a S 


x,(t) = eae.) + al Cosh E 





a,b, 
UR D ELED M 
l EN EB, : - ( 1*1 by 22143 ) 
ya,b d 2,0, 


227 
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le = y(t.) Sees va 


bes po) eee) 
m M. 4 sinh Game t) 4 (10) 
aio | 


202 


Neglecting drawn battles (terminal state C,,) the 
merminal states can be partitioned as shown in Table II. 
Using the optimal control determined by Eq. 6, the state 
equations, Eqs. 9 and 10 can be integrated in forward time 
me devermine what combinations of parameters and initial 
force levels can lead to particular terminal states. 

Meese conditions define the domain of controllability. 

wo additional items must be checked. First, the do- 
eins of controllability must cover the entire state space. 
Tf not, then there exists a singular surface where tre 
Pontryagin maximal principle does not apply and other 
m nods must be used to determine the optimal control. 

Puch a surface is not present in this problem. 

Ronde: omav be that the domains of controllasility 
tap. If this is the case, then the optimal control is 
ae One leading to the terminal state with the largest 
pay-off. Unless one terminal state dominates the other, 
the region of overlap is partitioned by a dispersal surface 
Nvo subregions from which optimal extremals lead to a 
particular terminal state. 

Dispersal surfaces are present in this case. The 
resolution of these areas can be found in Taylor [10]. “Hs 


Pots waver ts primarily concerned with numeriealzresults, 


12 





Table II. Terminal States 


State 1 X 


1 X» Ti 
E 20 >0 >0 =T 
52 >0 zii >0 za 
53 >0 >0 =0 = 
S4 =0 >0 >0 EN 
B5 =0 =0 >0 S 
S6 =0 >0 =0 em 
377 >0 EG =0 <T 
sg“ >0 =0 =0 S 


NE Specified duration of the battle. 

mar Time battle actually ends. 

pU - S3 partition C, (fixed-duration battle) 
ef — S6 partition C, (Y loses) 


eye SO partition C, (X loses) 


PX. Sestrovedviirsu. 


Se desmroyed finest. 


me question is resolved by computing the pay-off for each 
possible terminal state and choosing the maximum. 

Insight into the allocation policy can be ca ined. 
Eousjdeprsne tne interpretation ol therguantit icca 0s 
aos a Pand ad- The quentity a,b, (a. 05) is le enel 
or long term measure. It can be interpreted as a measure 


SMeriew rate ay wire 1 destroys X,'s (X,'s) ability vo 


20 





destroy Y. On the other hand, a,pla,q) is a tactical or 
Mort. Lerm measure. interprevted as Une mate aaa 


estroys X,'s (X,'s) value. By A8, a,b. 2 a,b so there 


Quac 

are two cases to consider. 

apps a.q, the sitmation isemelatively simple. 
m eceives more return in both the strategic and tactical 
mense by firing ab X,, Memce 10 15 nevemecoprimal vostire 
eee unless X, = 0. Accordingly, in this case, no 
extremals lead to states S3, S6, or S8. For all other 
terminal states, 0%*=1 until X,=0 or Y=0. 

Anas are more complicated if a,p"*.a,q, since Y 
ma ns a better tactical return by firing at X,, but a 
Ber Strategic return by firing at A,. At the termina- 
imeem of the battle, only the tactical return need berecon- 
pen eca, so clearly, $*(T)=0 as long as there are any X, 
EXUvors at T. 

memever, Simce Y is more effectivemin destroying X,'s 
EU capability than X,'s, it is in Y!'s best interesin 
mre at X, until there is just enough time remaining to 
MEE moy X, then shift fire. «Otherwise, Y will incur need- 


less casualties. 


zu 





IVa THES TPOCHASTIC MODE 


fee STOCHASTIC CONTROL PROBLEMS 

Te addiction of stochastic elements to the optimal 
trol problem" introduces several complications. "There 
NE "number ofwaespects which must be Cemsidered, since 
mmererent interpretations lead to different courses of 
action. ' These are discussed at length by Dreyfus [13]. 

me nate Of@amewtledeeser the underlying stochastic 
Beseess must be considered. In the simplest case, the 
Moperties of the process may be known. On the other hand, 
i the nature of the» process is not known, a learning 
element enters the problem. The course of action chosen 
uu cbe refined as the process evolves and knowledge ws 
gained. This is known as an adaptive control problem. 

outer Iipertaent Lacvorre1s thewabaiity voMNObservyve 
Mie State of the system. In the simplest case, the state 
DE “observed preersety-at any particular poant.— —If^vhe 
Beate Ts only partjallyrobservable, then an estimation 
problem must also be treated. 

Since the trajectory is no longer precisely determined, 
the objective function becomes a random variable. Among 
come alternatives fer treating wwe ob) ee ime function mire: 
The maximization of an expected value; maximizing the 
probability of reeciingee particular state; oreminimizing 


tuac avance ofthe terminal state. 
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A significant difference from the deterministic problem 
uSsobhat-uhe- mannepb-xnewhzehwatheecontroulwussoppüiscdeleaeds 
Moma itferem results. There are three basic control poli- 
Mes CO be considered: open loop; feedback: and open 
loop-feedback. 

Wopen loop control polmey. represents the case in 
Ber che control must be specified before the process 
dants and cannot be altered. In a process evolving 
Monen time, the control is expressed as a function of 
mnes given the initial state. 

Peerecadback or close loop policy assumes the abidary 
pueoutinuously observe the state of the system and modify 
maccoontrol. Mathematically, the control is expressed as 
EE ction of time and state, eiven the initial state. 

The open loop-feedback policy arises if it is impossible 
memcOntinuously observe the system. Generally, the system 
eaS Observed only at particular points in time. “in 
LAWS case, an open loop control based on the initial state 
EE plied to start the process. After an interval of time, 
M State is observed and another open loop control is 
applied, based on the observed state. This continues until 
the process terminates. 

It is fairly obvious that the feedback policy is the 
"best" of the three. The process can be rigidly controlled 
Since; Should the process start to Behave ina Nonoptinal 
fashion, it can be corrected immediately. In an open loop 


Sirvuarlon,~wommore Gellcate touch is required. There wisn. 


a 





way to correct any over=control.. The open Toop i ei oa k 
corresponds-to the- phy- -ical situation usually ne 
actual problems as opposed to the model. 

In the following se Cion, a feedback eontro la NEDE 
mound for a model where the underlying process is known 


wa che Staves are fully observable. 


EXACT SOLUTION OF THE STOCHASTIC MODEL 
ss T T T Icon tne deterministic model in 
Ma structure of the attrition mechanism. The physical 
satuation is the same as in Section II. Assumptions Al 
through A6 and A8 are retained. AY is replaced by 
i Only Mee casualties can occur and Y can 
allocate only Integer Numbers Of troops. 


mie Objective function is 


EE ey) =p (De ae) 
$ 


ios model treats the prescribed duration babule Joe 
= Ons similar to those of the deterministic model, it is 
musvenient to work in EE SUE time, t = T-t where T is 
Pies prescribed termination time. 

Instead of a deterministic square law attrition mecha- 
nism, the attrition is modelled as a stationery Markov 
process. The following probability statements are assumed 


mor a suificiently small increment of time AT: 
AO Prob | one Xc acualty rAr- a, yoAt 
PaO moge tmam one X, casualty in At] 29909 
Prob [ one X, casualty in At] = (1-96) a,yAt 
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Probal more than onc casta SO I 


Peoberone x casn da Ar lO ESO ae 


Prob [more than ene Y casualty in T4t] 5 9089) 


Prob [more than one casualty of any type in Ar] 
= O(AT) 


where o(At) is a quantity such that lim A = 0. Given 


| AT>O 
Euccabove, ivt follows that 


[uo e UEM mM S da, ,yAt + o( At) 


a similarly for A, and Y. 
ne. assumption that Y has perfect information about 
Une State of the system at any time and the ability to 
m umtaneously shift fire leads to a feedback or closed 
woo optimal control. 
MR olv this model, the optimal €xpected value miL retiron 


peas defined as 


EU ey CO) er re 


peren that whe state at time 1 is x,(1), = (T) and y(t) 
wne nat an optimal control has been applied in the interval 
ND]. 
Trable IMI lists five events wnNicn could take place in 
my ınterval of length At, Lt, 1-41] and their probability 
ef occurrence. An expression for S(T, X 


x VI Ms 


1? 2°? 


developed by the application of Bellman's Principle of 


pta) [LI whch states: 


ep 





Mab les IT LI Transition cero ide 


State Qt Casualties Probability 

E ox, y none = (da, y ay Sere 
+ De eee 

EE, y-l Woo x. duboor E 

Various o(AT) 


An optimal policy has the property that, whatever the 
wena state and initial decision are, the remaining 
decisions must constitute an optimal policy with regard 
meme state resulting from the first decision. 


By definition, the return from any of the states listed in 
Table III resulting from following an optimal policy to 


the end of the battle is S(T-AT, X,, X, eee here! ec 


the optimal value of ¢ in the interval [t, t-At] is the 
one which maximizes the return expected, starting from 


eve X,, X,, y at time t. This can be expressed as 


ST, xc durs y] = max {{1 - {oa,y + Geer 
OSoS1 


tere ees B x, y) 
3 Penne (Ta Aten easy) 
* (1-0)8,yAtS(1- At , X, ,X,-l,y) (11) 


A SATA AO CET) 
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SIE (1 — AO X,, y) M6es not dependiente hoconta dl 


] 3 


variable, 0. this can be rewritten as 


A O E 
AT 


DES (e lO 
OSS] 


no X Nx E 
t y{oa,[S(t-At, A OS ee oe 


D (1-o)a,[S(t-At, Xi» Xa l; y) e S(T-AT, Xi Xo» y)] 


O(AT) } 


a AT 





Bun che limit as At=0, 


ae en X.. y) 


E AS O O ME) 


O 


+ y max a(t) oe O E A a 
ee ac M PU NE 


SEM uu Ea) Mc 1 eon 


t SERIES TAN m dur y) = Suse X15, X25, y)] 


ef 





Equation 12 can also be-obtained dirceetiy irom Kenhner!s 
Semeral result on the optimal control of a “Poisson” 
process sae 


Mo derermrme q, Tie sweets Lunction 


ug ccce) "Suse, X y 


=a, SN T: Ay > M E y) = STIS X» %5 y )) CS 


is used. Equation 12 then becomes 


ots X15 X59 Y) 


T (b,x 


IPSE LO DE Xo ya 


1 S 207 


RE Sere Xis Xs» y)} 


+ a,yiS(t, Ao x,-1, y) Em ST, Xis X,» y)} 


+ y max {ow(r)} 
Os dS) 


H the optimal control is given by 


1 unu O 
T) = 
0 w(t) < 0 


ma the Gdemerminismac case where the optimal control 
depended on the dual variables, it was necessary to treat 


Me where a force is driven to zero Separately since 


“This contains a tI Poeraphical error: ie unnumbered 
ENUatlon after Eg. { should read 


n n 
= mi + V, + - 
0 n ee \ a L G TEE 


HE TT ELT Lo Dreyfus result [13]. 
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the boundary influenced the solution for the dual varia- 
zes. In the stochastic caseo The optimal controle nenas 
wey on the optimal expected value function. As shown 
meow, the initial conditions for S are easily determined 
EE cua force 15° driven Lo Zero. Inereñore., norspectadl 
distinction between the fixed duration and the fight to 

meget inish battles is necessary to solve for the optimal 
Sm ected value function. 


IE 7-0 (ie at the end of the battle), then 


BIO. x, xX,, y) = TY - px, - ax, (14) 


O values x,, x and y. 


2) 


IL 0, there is no battle and 


ENS x. X.,0) = (px, * qx,) e 
NUSL! values of T, X,, and x,. 

Ewurlarly, 1f x, = x, = 0, there is no battle and 

E. 0507 y) = ry (16) 


NS ll values of t and y. 
INNEN UU. then clearly, 6.= 0 for all. anda. 12 
AA 


Et. 05 x y) 


HT = b,x,[LS(T, So 


9) y-1) = SH Dr xol 


Towers Oo NUT SONNO e TE 


2? 
with the initial condition from Eq. 14 


S(0, 0, x,, y) = ry - So 
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particular. Lor y I 


IO 
dt 


pe, ee, 


+ a, (S(t, 0, 0, I), SS O A al 


A o E O 


Bene Bas. 15 and 16 or 


SO LO) 


alí A 


A DIE 0, 1, 1) +4 ap ae ee 


with S(0, 0, 1, 1) = r - q. This is an ordinary differen- 
pod equation of the form 


B CX t 
dt 1 Co 


En bos easily solved to give 


bir - ard 
S(t, 0, 1, 1) = |-———-~—! ex Cas et 
> > > AA PE 2 2 } 


E M in 
SUE 
Se cubo = OT S cimo MO 
X. = y= l, Eq. le reduces to 


1 


dS(1, 1, 0,1) 
dar 


n 


A ID 


ii 


E ccm od Cs Oe el) a ieee 


with S(0, 1, 0, 1) = r - p. The solution in this case is 
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(18) 


Peeing x, - x, = y = 1, Eq. 12 becomes 


dS(t, 1, 1, 1 V 
pu a BES cs d To cs MEN 


M uide ein] 


panas cM LE) ide. o S] 
QS 


a IS Al) (19) 


De switching function deémemmines o. At the end oF 


Ener battle 


w(0) A O ee AN 


= a.p = a. q 


so there are two cases to consider. 


l. Case I 


M) = 1 for 0<7TÉT 


l where ps SA Y 


ches fire trom xX, Lo A, determined Dy 
M = 0, 


This is consistent with the interpretation of QOEM 


Cee e eane aS OCRE rT iny, at the end ol the baten 


s: 





should direct bus ire. tog T neto Lo A A 


pias case, Eq. 19 becomes 


do c eam A. 
ON + scc, A _ 
at (Dent, A, IÓ 


tu T eU SA 


fee che initial condition 
Bo, .1, ll) =r =p = 7. 
mm@eesclcvuting Eas. 15 and 17, the solution is given by 


a,(b,r - a,q) 


ST, p ls 1) = Ta, + bd, - @,)(a, + b,) CXD [- (a, berg, 


n Now x aC + b) t cicer na aP 
a Dee a) (mo Pe a a S 
4 N 
ar o + aa. O un 
a.a,r 
- (a, * b, + b,)t} + z 
Be | i : : A a 
Gor + b,)p MER Be Eee 
(en En) E 


mee O < t § T 


DE ET TT HIE ls deber= 
Died. Depending on the value of 7, it may be thay er, 
and so no switch occurs during the battle. If 1,<1, then 


Vene ja As A SAS eine of switch 


E A (w(t,) = 0}, o*(T) = 0 and 


32 





a E ; 
S CTS 2 d: 15 = (a, * b, - a,)(a, +b) l XD Ma 


l l 


re En a weg 


| an; 
+ S, e 


| 0 (a. + bay) Gay i p t b.) 


l l 
(Cb, + bad(a, + bi) + e;b,lp | (b, * b,)q 
y e y Ca, M 2 M p fus B b, 2: SE 


Seve 


exp [-(a, * b, * b) (t - 1,)) + | (a,*b,)(a,*b tb, 


[Bio hu CCS ERE Ea. D. Tp Oot boa 
a m b,)(a, 3 5, us DM CH i b, i Em 


Decree S, = e I NM 
Ep vase II 
a,g > a,p 


MU o ere 1) ence 


1 


time that fire switches from 25 Ge ER Por cnis interval 


AO 


Eon E (REDEEM CHEER E (-(a,*b, 21) 


EIU ne SONNO PRECES NONI 
N O eine Deep 


on 
n 
A AD 
ad] 


Ec TS | exp{- (a, + b,)t] 


3 





amra r CDA a tee) + a 


ee aoe (a mb Ja DD 


ELEC 
bat 


emer, then for T, $ t $ v, 


SM D. Iu 


Era) = (Fo -a,)(a,+b,) ero COMAS NE 


exp ((a,+b)(T,-1)-a,1,-b,T) 


S MUS G 
4 S _ L 2 4 1 2 
0 (O E ED (a5 tot) 
[Cb +b }(a tb, )+a,b, Jaq 
4 E ere le Vitae bab 5) Gr ee, 
1 l 2 2 2 
R np (ore. 2 
Cae UE (a ba oe 
Ñ Da. TA 
(MD CS) 
Bee da l,1) where Tis the time Dire is shifted back 


to X,. 

With S(1,1,1,1) known, there is no mathematical reason 
why Eq. 11 cannot be solved PONS AE) Ao 1.) 
EL in hopes that eventually a general. solution for 
AX 5 3 Xpand) might emerge. For the stochastic model corre- 
Soondince to thesdsinear law attrition process, such a pemeral 


solution has been obtained by Clark [16]. 
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No general ER for. thus model js Joni nOD 
mae complexity of the expression for S(1,1,1,1), it is 
®ovious that extensions will quickly become very unwieldy. 
A numerical approximation for S(t,x,,x,,y) appears to be 


amore profitable line of approach. 


EX NUMERICAL APPROXIMATION OF THE STOCHASTIC MODEL 
In the development of the differential difference 
eawation for Sy): a suítable numerical approxima- 


mom was also developed. 


EAT Xy) = max | (1 - (da, y E 
DEl 


E MATS UE 


EM Mo) 
ue s DAS. L SIM) | Cin) 


fee determined by the value of the switching function 
eer in Eq. 13. 

This is essentially the Euler method of numerical 
EUsroximation. It has the advantage that as At>0, the 
Value computed above will converge to the true value of 
Ex > < TT 

To obtain a reasonable approximation, the value of 
the time step, At, must be small. There is also an addi- 
Monal restriction on At. TIn order Tor the probabikiiy 
Svavementawacsumea In AG Compe meaning Ulm AT MUSTIDE T UECI 


tnat 


99 





Kor 


SEM 


IA 
p 


a,yAt 


(bx, + become cl 


1-1 


all values of x A COn L dered: 


l 2 


There are several special cases of Eq. 


ore ey) “Seyeeepx, 0 
O) PA = 


=7,0,05y) = ry 


ON) = S 


Lly 


T Ay (box qS9(T,0,x. , yum e GI Y) 


meee p = 1 in this case and 


erat, *,>,0,y) = St Aa) 


+ a,y(S(r,x,-1,0,y) - S(r,x,,0,y))) 


ce © = 0 in this case. 


ENS run on an IBM 360/67. 


paves © aS a function of v for fixed values of D 


The above equations were programmed in Fortran IV G 


and y. 


The output is a table which 


2? 


ime vhe "special case of S(t,1,151), the accuracy cian. 


approximation was checked against the exact solution 
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developed in Section 111 B. The results of one such 
comparison are given An Tablon Lo taa ce NIMM 
phe approximation agrees with the exact solution to the 
Neto decimal place. 

Hor a given force level; the approximation must four 
eolculate the values of S for all combinations of smaller 
NE gl!ceveis. Hor larger force levels, this requires 
a large amount of computer time and memory. For a rela- 
mively large time step of At = .01, computation of 
eee 5.5) for O0 = t $ 50 required about four minutes and 
200 K of core. To solve the same problem for S(1T,9,9,9) 
Log require about one hour ana 500 K. Therefore, the 
Moers cal results from this particular approach are 


naed CO relatively small force levels. 


p 





Table. IV. Comparison or Mac o oli 


and Numerical Approximation 


D Exact Approximation 
in minutes STE.) 
0 | -.2000 =. L 000 
1 .2018 2 01O 
E To ae 
3 A055 Jem 
T NOE m 
> .2091 ¿US 
6 EI .2108 
T Neu SONNO 
8 .2143 .2143 
E sl ro! 
10 ar, SENTO 
11 215 „2195 
l2 re? .2211 
ÉS 12229 He elo 
14 ees ‚2245 
15 2262 Deo 
16 ASUS PONO 
17 ee. ‚2294 
18 me SL e ne 
17 rose 2320 
20 Bore ‚2342 
en NEED IN 
2o POR as 
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Table IV. (Continued) 


T Exact Approximation 
in minutes SERE T) 
a3 -.2390 .2388 
24 ~.2405 2404 
> ea Jugo 
26 -.2435 as 
27 -.2450 .2llo 
20 -.2465 ¿2464 
an -.2480 ‚2479 
30 -.2495 .2193 
p -.2509 .2508 
32 -.2521l .2522 
DS -.2538 sea 
34 = 252 .2551 
35 -.2566 a 
36 ~.2580 eam 
ET -.2591 we 
38 -.2608 22596 
39 2,2022 .2620 
40 225555 eos 
41 -.2649 .2647 
42 20102 .2660 
43 -.2675 203 
44 -.2688 2000 
45 O .2699 
46 ees Sea 
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Tab ke ee consu 


E Exact Approximation 
in minutes ETE) 
47 =.2127 -,2725 
48 -.2739 = ai Si 
49 - 2052 O 
50 -2701 -.2762 
^ = "005 c 2003 by = aa n E 
pee = .15 A p TO A ene 
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V. COMPARISON OF RESULTS 


For the 125 combinations of force levels from 
nn ey eer up toand AMS Tx. = <= y =. > 
merculavions were carried OU aor each of the four sevs 
of parameter values listed in Table V. A time step of 
~Ol minutes was used in the numerical approximation. 
Comparisons of selected results are given in Tables VI 
IEEE XIV. 

Meese tables were constructed by extracting the force 
Mel time history from the deterministic model. Since 
EN Ucterminusstioc model calculates force levels as contin- 
Me iunctions of time, there is a question as to exactly 
ieee Casualty occurs. For these tables, deterministic 
meee levels are rounded up to the next integer, i.e. 
tee 3-001 is rounded to x, = 4. With these values of 
time and force levels, the optimal expected value function 
and the value of 4% were ned from the appropriate 
Eeeenastic table. All comparisons are Tor the case a,p<a,g. 

tE: Sea paa er Lenin ons Se red “iver 
the above force level combinations with parameter Set 1. 
mar oOoLn the stochastic and deterministic model, there as 


mo shift of fire unless Ze is driven to zZ ro; 
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Table V. Parameter Values for 


Numerical @aleulations 


Set = ar D. D. p q p dt 
1 1005 003 O -00T TES AS E 50 
2 2005 2003 007 290 SA , 45 E 100 
5 2025 J05 025 -005 S NEO 20 50 
lj 105 so 077. zen 15 4.5 4.0 50 


luco vi. Comparison for x (0) = x,(0) = y (CO) ql 


with Parameter Set 2 


Time Porc mec ied Star D 
in minutes x, x, y Deterministic Stochastic 
0 JE jc I i -.3175 
19,91 Ji l i i 0 -.2762 
56.38 Hi SN 0 O -.2686 
TOO i 1 i 0 0 -.2000 
RB a rministie Pay-off -.4127 


anal State Sl 
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Tabte VITIT O NP o E x, (0) = y(0) = 5 


with Parameter Set 2 


Time Force Level S (tor ey 
in minutes x, x, y Deterministic Stochastic 

0 > > 2 Hi l -.6231 

af. 5 3 ! 1 I -2.1729 

50 Y 5 4 I l -1.6712 

55 u 5 4 i O 0 

56 u 5 3 il U -2.0558 
BO. 39 ! D E U U -2.0501 

X H 5 2 0 O -2.1846 
100 U 5 2 - - -2.0500 


Deterministic Pay-off -2.0637 


Terminal State S1 


> 








Mable VIII. Comparison for x (0) = 4 x0 ncc UE M 


with Parameter Set Y 


Time Force Level o * SER 
MoEUnubLes xl x, y Deterministic epoca ne 

0 4 5 E 0 1 -16.9539 

T u 5 | u 0 T -20.5330 

T H D 3 0 1 -23.0807 

9 4 > 2 0 0 -25, 335% 
10 U H 2 0 0 -20.2005 
ILS} H u 1 0 0 -20.9796 
15.51 4 u 0 - - -24.0000 


Meterministic Pay-off  -—-23.2951 


Gemminal State Sl 


ete IX. Comparison for x,(0) 22 x,{0)=5 y(0) = 3 


with Parameter Set 3 


Time Force Level p* S(t,x, x, y) 
in Minutes x, x, y Deterministic Stochastic 

0 2 5 3 E iL -8.9286 
iiS A il UH -11.1566 
18 ie AS 2 il 1 -9.1233 
BL l D 1 1 m -10.9620 
ED. 359 1 5 a il 0 -10.7862 
41.28 i E 1 U U -10.5445 
50 1 p E -— =- -10.0000 


Deterministic Pay-off -10.9471 


Terminal State SI 
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Table X. Comparison for x,(0) = 4 x,(0) =5 £y(0) = 5 


with Parameter set 2 


Time Force Level p* SC) 
in Minutes x, x, y Deterministic Stochastic 
0 E 5 T J 1 -8.8300 
9 3 D I al -11.2142 
13 2 J 5 il ji -8.9147 
20 2 5 2 1 l -11.0357 
3! 2 5 il 1 0 -12.0296 
36 l 5 1 1 U -10.8092 
mi. 270 1 5 l 0 0 -10.5£4145 
50 al E il — - | -10.0000 
Deterministic Pay-off  -11.6727 
Pedal State Sl 
Table XI. Comparison for x,(0) = 4 IS UU o 
ULL dU D cL CUM 
Time Force Level pr SE Ay) 
minutes X, X, y Deterministic Stochastic 
0 Y 5 0 al -8.4801 
7 4 5 4 0 1 -10.4644 
186 Y 5 3 0 1 -11.7839 
19 lj 5 2 0 U -12.6693 
20 ho HH 2 || 0 0 -10.3609 
25 TE ET 0 0 Os? 
E395 4 4 0 = = NS 


Deterministic Pay-off -11.6476 


comu scc es 
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Table XII. Comparison for x, (0) Em 


Time 


in Minutes 


0 

T 
10 
16 
2 
26 
BY 


41. 


50 


28 


X 


2 


X 


Cc Ml: | 


with Parameter Set 2 


Force Level 
y Deterministic Stochastic 


2 
H 


ÑO 


= H 


Beserministic Pay-off 


Terminal State Sl 


-9.2835 
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x,(0) = 


— 


LA He H 


y(0) 


E 


E 


.2034 
.8186 
225 
365b 
BI 
SIS 
517 
400 


29190 








Poble- XIII: Compari on ier 10) = 3 xD = 5 O y 


with Parameter Set 2 


Time Force Level d > SL eee 
Ua Ree x, x, y Beterminiseic oveehastic 
0 3 B 4 l al -8.1836 
9 3 D 3 al 1 -11.214 
NES 2 5 3 l al -0.918 
20 2 5 2 1 1 -11.036 
34 us 1 0 -12.030 
36 je 5 1 1 0 -10.809 
41.28 1 5 1 0 0 -10.545 
50 dh 5 1 = - -10.000 


Deterministic Pay-off  -11.6727 


Terminal State Sl 


Meme XIV. Comparison for x,(0) = x,(0) = y(0) = 5 with 


Parameter Set 1l 


Time Force Level o* Std mt y) 
Exeunuves x, x, y Deterministic SOC Masta c 
0 D D > 1 1 -1.509 
EINST D 3 > 1 0 -1.446 
6.38 DL cu 0 0 -1.435 
26 S a 4 0 0 -1.665 
50 pc d - - -1.400 


Deterministic Pay-off -1.5216 


kerminal states 


= 





VI. CONCLUSIONS 


Due to the restrietioms Wet the sto@hastic model to 
EMO! foroe levels because of computer constraints, it is 
evt torreach any general conclusions. There are, 
w ver, several interesting things which can be observed 
om. the deta. 

In the case where a,q>a,p, the models lead to target 
selection rules where the time fire is shiéted differs by 
Aten. as seven minutes. If the deterministic rule is to 
feet wire Defore X, is destroyed, the stochastic rule Is 
EN t fire at an earlierstime. This can be explained by 
ai interpretation ef whe model parameters similar to that 
EREen in Section III. 

BEncerncUnem obtained" by "eem at Ay fs mainly ren 
RES UPOyingp his kill capability. More Y's survive for a 
longer period of time. As the battle progresses, the 
MA ty of Y survivors in the future decreases until a 
pent is reached where the return from firing at ne drops 
mI rapyOdly. Conversely, the return from firing at KS is 
merci ly from destroying his value. “As the battle "progresses, 
[uc return irom Pring at X eventually exceeds that om 
INE AA, he de TERA Seo SO COS SONIC 
Pont is known precisely. =@n the other hend, this crose— 
over point is not precisely known in the stochastic model. 


The use of expected values tends to force an earlier shift 
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to keep away from the area where the A, return decreases 
Mepidily. In Other words, seme er the future Vai were: 
crvivorse ie =sderifaced to ensure thatthe heeherwervecurn 
Meom tiring atl X, is mot missew In the case where 
Bars this does not occur since it is always to Y's 
advantage to fire at X,, both in terms oí value destroyed 
EMG future survivors. 

dc X eewwump in the optimal expeeted value Tunevron 
Ae casualties occur is caused by the integer constraints 
ee ume Stochastic model. This does not happen in the 
Meaberministic model sánee force levels are calculated as 
Eoevsmuous functions. As t — T, the optimal expected value 
function approaches the deterministic pay-off. 

There are a number of areas which need additional work. 
Mest obvious is the need for better numerical techniques 
Nor the stochastic model. One alternative 1s to reprogram 
Maus Enodel to use tape storage r8ther'* than core. In this 
way, a series of small computer runs could be used to build 
up a file of values for smaller force levels which could 
then be accessed to compute still higher force levels. In 
Ls case, an inwestigpetion of the trunmcation errers weuld 
Bere to be made to determine the degree of accuracy in the 
I cures for higher force levels. 

Another alternative is to consider @ diffusion apprexi— 
Mation to the stochastic process. some work in this ered 
has been done by Taylor [10], leading to a parabolic partial 


differential equation which is not easily solved 
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T 1t can be solved numerically.: rmi apro en 
ap oears promising since stousudd not be meces sario ala 
ier 3ll combinationseot foree develo below the desir none 

This approach to the stochastic model yields no informa; 
mmem about the time nistor olhe amenas Lor ce Me ve ls 
Sethe probability of winning. Clark [16] was able to 
@uvain expressions for the average force levels in the 
linear law case. If a similar solution for the square law 
pase could be obtained, more meaningful comparisons could 
er zmade. 

Merece. also. a number of extensions. Lo the determin. 
Sic model. The zero-one nature of the solution is hardly 
Mts tics. It is a result of the square law attrition 
Ee anism tema: the constant attrition coefficients. One 
w ao investigation would be to make the attrition coef- 
clients a function of the fire being received. Other 
areas of extension are the two-on-two, one-on-m, and m-on-n 
battles with various types of attrition mechanisms and 
Moerficients. 

in summary, the numerical results, woile inconclusive, 
do indicate a significant difference in results between 


Mae stocnastie end deterministic modelling dpprodenes. 
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AE ED RC 


Domains of Controllability 


Case I. a,p28,q 























x, (T) > 0 
Si Beech) > 0 9%*(t) = 1 ST 
ary > 0 
Requires T < TSl where 
d . 2 2 
Eme] lue by NE ES 
a D 
] 
E in : if a.b.y?(0) » s? 
LS) 15 
¿OM 272 
TS1= 
x "nep A T NEED ES 
va,Db, 
ii a “eon yO) 
tanh - ee 
va,b, E 
2 2 
nr a,b,y*(0) < s, - Ms, 
2 
Y a,b,y^ (0) sg Brenn = PRESOS 
y = o————————————————— 
VO YO) s 
x, (TS1) = 0 
1l Q cS. "Don 
oe NCC Gia 0 $*(t) = 
TO p 
Py CSO 


balk 





Rines aM ue Bea 


Todes 
RAT) 0 
S5 eee) = 0 No extremals lead to this state. 
Ar) > 0 
ze) > 0 
EI NE > 0 9 NE cec coy 
war) = 0 
Requires a,b,y^(0) « S - (b. x gp 
dcc 
ze) = 0 | 
il Oe ees ll 
55 XE >>0 o*(t) = 
U IT iG Sa 
y(T1) = 0 


Requires S* - (b,x,(0))" - a,b, y?(0) < s? 


+ (R-1) (b,x,(0)) * 


THE T 
ze 
S6 x Iu) z No extremals lead to this state. 
(y (T1) = 0 
x, (TS1) = 0 
IL Me ns 
s7 O 0 o*(t) = 
U DUM ONT 
ıy(T1) > O 


De 





s 2 2 2 
Requincs En Oto (IMEEM 


TIT 
XU. =O 
ES Maa) = 0 No extremals lead to this state. 
worl) > 0 


Enc II. agp * a,q 





|x, 0m» 0 Or NOS a 
S1 Ze > 0 o*(t) = <1 Dear Des 
Zum 0 lo T-181<t ST Af 181. <T 
2 2 
Were Tol = 1 ln | | 
Ya,b, 


Pres T < Tol Mire 


Ya,b, y(0) 
ao ee re). 
va, b, sVR 








Se - (b, x, (0)) "T 
TS1= 





may) di) Rie o A 2 (0) ste 





Ya, 5, 








l S 
in iO Duy OP Hee 
VIE | DS | a. 





a OD 





Va, D 


5 








e E De 
sYR - Ya,b, y(0) 
2c, sya) O) 
l OSes) oe 
ae D $*(t) - 
0 Se TOS UL 
Wy (T) > 0 


Requires al > 3° -= (5,x, (0) * and 


Tol + TS2 < T where 











ne mens, (or 
Yab, 
Gos in | : | zem 0 Es 
I M 1-1 
As 2,22 
ley) E bey (0) NS 
Ae tt 
2 
Jem. wc S [IS e - b,x,(0) 
Y e ————————————— ———————————————— 
Ya,b, y(0) - s 
Gey > 0 
1 O SEES 53 
poU LEO $*(t) = 
0 jus e ST 
SO 


Requires TS1 < T and T - TS1 < TS3 where TS3 is a 


FOC OI 


0 = (1 + L)[s cosh (y,) - va]5,y(0) sinh (y,)] 
VR 
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2 za £ i cosh (y,) = ab, Oö) sip PN 


= § cosh (an TS?) 


— <= = 


+ ON LO Sen b,x,(0) 


Y, = Ya,b, (T- TS3) 4 va b, TS3 
voee vob. T- Te SS 


AO 


S4 X T) > 0 








ey CEL) = 0 
= qm | erty a el | 
29D, | 
(ao) When 154 > TI ó*(t) x O USC EC SC qu 
Hec es 


2 


a,b,y2(0) < Rs? | aL es +} 
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